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There  Is  evidence  that  comaanders  and  managers  In  inai\y  Air  Force  organizations  are  not  fully 
satisfied  with  existing  procedures  for  measuring  organizational  productivity*  Productivity 
measurement  and  enhancement  research  and  development  (RAD)  has  recently  culminated  In  a 
significant  breakthrough  to  solve  this  problem:  A  series  of  technologies  called  the  Methodology 
for  Generating  Efficiency  and  Effectiveness  Measures  (M6EEM).  which  permits  the  creation,  in  any 
organization,  of  a  complete  productivity  measurement  system. 

After  becoming  familiar  with  a  target  organization,  a  measurement  facilitator  begins  phase 
one  of  the  MGEEM  process  by  convening  a  meeting  of  the  comaander  (manager  or  supervisor)  and 
his/her  Immediate  subordinates.  This  group  Is  confronted  with  the  question,  "What  does  the  Air 
Force  pay  this  organization  to  do?"  Consensus  on  the  answers,  called  Key  Result  Areas  (KRAs),  Is 
developed  through  a  structured  group  process.  Phase  two  Involves  a  meeting  with  the  commander's 
subordinates.  For  each  KRA,  the  measurement  facilitator  asks  what  the  commander  needs  to  know  to 
determine  how  well  the  organization  Is  doing  on  this  aspect  of  the  organization's  productivity. 
Consensus  on  the  answers,  called  Indicators,  Is  again  developed  through  a  structured  group 
process.  Examples  of  KRAs  and  Indicators  are:  (a)  for  a  repair  shop,  quality  of  repair  and 
quality  control  Inspections  passed;  (b)  for  a  personnel  office,  timely  and  effective  staffing  of 
positions  and  percentage  of  positions  filled;  and  (c)  for  engineering,  customer  support  and 
percentage  of  work  orders  accomplished.  Field  tests  In  24  Air  Force  organizations  showed  that 
these  two  phases  of  the  MGEEM  are  acceptable  to  participants,  produce  a  productivity  measurement 
system  Judged  by  commanders  to  be  sufficiently  comprehensive,  and  are  cost  effective  In  that  the 
Indicators  can  usually  be  formed  from  existing  data.  In  the  third  phase  of  the  MGEEM, 
computerized  Indicator  data  are  periodically  reported  to  workers  and  managers  according  to  the 
principles  of  feedback  and  goal  setting.  These  principles  have  to  do  with  Issues  such  as  the 
frequency  and  objectivity  of  feedback  and  the  acceptability,  difficulty,  and  feasibility  of 
goals.  A  comprehensive  field  test  of  the  complete  MGEEM  system  with  feedback  In  five 
organizations  of  the  67th  Tactical  Reconnaissance  Wing  showed  Improvements  In  organizational 
productivity  of  from  35%  to  50%. 

Evidence  shows  that  the  MGEEM  requires  the  time  and  continual  strong  support  of  the 
commander.  Possible  risks  associated  with  Its  use  Include  misuse  of  measurement  data,  shifts  of 
resources  to  activities  that  are  being  measured,  and  anxiety  of  personnel  about  the  measurement 
of  their  performance.  Suggestions  are  made  for  the  Judicious  use  of  the  process  to  reduce  these 
risks. 


This  Is  one  of  two  technical  papers  (TPs)  on  the  Methodology  for  Generating  Efficiency  and 
Effectiveness  Measures  (MGEEM),  a  multi-step  procedure  by  which  a  complete  productivity 
measurement  system  can  be  created  for  any  organization.  While  the  companion  TP,  Implementing 
MGEEM:  A  Manual  for  Air  Force  Measurement  Facilitators,  provides  sufficient  technical  detail  to 
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PREFACE 


This  Is  one  of  two  final  technical  papers  fron  Task  13,  Technology  Transfer  Plan 
and  User  Manuals  for  the  Methodology  for  Generating  Efficiency  and  Effectiveness 
Measures  (MGEEM),  for  Contract  No.  F3361S-83-C-0030,  Contrlbutive  Research  In  Manpower 
and  Personnel  Technologies.  The  other  technical  paper  Is,  laplenientlng  MGEEM;  A  Manual 
for  Air  Force  Measurement  Facilitators.  Both  technical  papers  are  user  manuals  for  the 
MGEEM.  The  conceptualization  and  field  test  of  the  MGEEM  are  documented  In 
AFHRL-TR-81 -9,  Productivity  Measurement  Methods;  Classification,  Critique,  and 
Implications  for  the  Air  Force,  and  AFHRL -TP-84-54,  Field  Test  of  the  Methodology  for 
Generating  Efficiency  and  Effectiveness  Measures. 
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METHODOLOGY  FOR  GENERATING  EFFICIENCY  AND 
EFFECTIVENESS  MEASURES  (MGEEN):  A  GUIDE  FOR 
COWtANDERS.  MANAGERS.  AND  SUPERVISORS 


1.0  INTRODUCTION 
1.1  Mho  Should  Read  This  Manual? 


If  you  can  answer  "yes"  to  the  following  three  questions,  you  will  benefit  from  this  manual. 

a.  Are  you  the  commander  or  manager  of  an  Air  Force  organization? 

b.  Would  you  like  to  Improve  the  efficiency  and  effectiveness  of  your  organization? 

c.  Would  you  like  to  Increase  the  commitment  of  the  people  In  your  organization  toward 
the  unit  and  Its  mission? 

Although  the  Methodology  for  Generating  Efficiency  and  Effectiveness  Measures  (MGEEM)  Is 
primarily  directed  toward  helping  Air  Force  managers.  It  Is  fully  consistent  with  priorities 
established  by  the  Conmander-ln-Chlef  and  with  Air  Force  regulations.  In  a  memorandum  to  the 
heads  of  Federal  executive  agencies.  President  Reagan  (1985)  stated  his  view  of  the  Importance  of 
productivity  Improvment  to  the  nation: 

...  I  have  asked  the  Congress  to  demonstrate  Its  support  for  a  government¬ 
wide  program  to  Improve  Federal  productivity  by  passing  a  Joint  resolution 
declaring  productivity  Improvement  as  a  national  goal. 

Air  Force  Regulation  (AFR)  25-3,  Air  Force  Productivity  Enhancement  Program  (PEP), 
established  productivity  Improvement  as  a  priority  In  the  Air  Force.  This  regulation  properly 
acknowledges  the  fact  that  responsibility  for  productivity  Improvement  In  Air  Force  organizations 
rests  squarely  on  the  shoulders  of  managers: 

Using  resources  In  the  most  efficient  and  effective  way  possible  to  accomplish 
an  assigned  mission  Is  a  manager's  primary  responsibility.  Meeting  this 
responsibility  with  today's  limited  budgets  and  expanding  mission  requirements 
places  a  premium  on  management  excellence.  Productivity  growth  Is  essential  If 
we  are  to  meet  these  management  challenges,  and  a  systematically  developed 
program  Is  Just  as  essentia)  to  achieving  that  growth.  (AFR  25-3,  1982,  p.  2). 

The  MGEEM  Is  an  Important  part  of  a  "systematically  developed  program." 

But  President  Reagan's  proclamations  and  hundreds  of  lines  of  Air  Force  regulations  will  not 
make  productivity  enhancement  occur  In  the  Air  Force.  It  will  happen  only  If  people  like  you 
decide  to  make  It  happen  and  become  conmltted  to  this  goal.  If  you  are  truly  Interested  In 
making  your  organization  the  best  It  can  be,  this  manual  will  be  a  valuable  tool.  It  Is  not  a 
panacea,  and  It  contains  no  cook-book  solutions.  It  will  take  work,  persistence,  and  continuing, 
visible  support  from  you.  The  only  guarantee  Is  the  knowledge  that  you  will  be  doing  the  best 
you  can  as  a  steward  of  the  public  resources  assigned  to  you.  Perhaps  even  more  Importantly,  you 
have  the  opportunity  to  bring  forth  the  best  performance  possible  from  the  other  people  In  your 
organization.  Of  course.  If  the  result  Is  that  your  organization's  performance  Improves,  you 
will  receive  the  additional  recognition.  However,  ultimately,  for  most  Air  Force  managers.  It  Is 
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pride  In  doing  a  good  Job  that  drives  them  to  carry  out  the  types  of  day-to-day  effort  that  make 
the  NGEEM  and  their  organization  fully  successful. 


1.2  What  Win  You  Learn  From  This  Manual? 

1.2.1  Measurement  Is  a  Key  to  Productivity  Management 

"What  you  measure  Is  what  you  get"  Is  more  than  a  catchy  phrase.  It  Is  an  accurate 

description  of  the  role  of  measurement  In  the  management  process.  When  the  wing  commander  begins 

to  track  missed  appointments  at  the  base  dental  office,  the  number  of  missed  appointments  goes 
down.  When  field  grade  officers  stand  at  the  gate  and  observe  the  number  of  vehicle  occupants 
who  wear  seat  belts,  the  number  of  people  "buckled  up"  rises.  Measurement  gets  results. 
However,  there  are  costs  associated  with  measurement,  and  measurement  carries  with  It  certain 
risks  from  the  standpoint  of  managers  and  commanders  In  terms  of  who  gets  the  data  and  how  the 

data  are  used.  The  MGEEM  Is  designed  to  minimize  these  risks  and  to  be  a  cost-effective  method 

for  use  by  an  organization  to  define  key  Indicators  of  efficiency  and  effectiveness.  This  manual 
will  serve  as  a  tool  to  help  you,  as  a  commander,  to  decide  If  this  tool  can  benefit  your 
organization. 


1.2.2  What  Is  the  MGEEM? 

The  MGEEM  Is  a  multi-step  procedure  which  leads  an  organization  through  the  process  of 
defining  and  prioritizing  Its  principal  Intended  objectives.  Once  Its  principal  intended 
objectives  or  Key  Result  Areas  (KRAsl  are  defined,  the  organization  Identifies  indicators  which 
can  be  used  to  signal  whether  the  KRAs  are  being  accomplished.  In  developing  the  indicators,  the 
procedure  makes  use  of  input  from  those  whose  productivity  is  being  measured.  A  principal 
component  of  the  MGEEM  Is  a  structured  group  process  called  the  Nominal  Group  Technique  (NGT)  — 
a  combined  brainstorming,  voting,  and  discussion  technique  which  efficiently  promotes  group 
consensus.  The  NGT  is  widely  used  in  both  public  and  private  sector  organizations  to  generate 
productivity  Indicators.  Once  indicators  have  been  defined,  they  are  reviewed  and 
operationalized  In  a  management  information  system.  The  MGEEM  draws  upon  research  on  feedback 
and  goal  setting  to  suggest  ways  in  which  indicators  can  be  used  to  enhance  productivity  and  the 
quality  of  working  life. 

An  analogy  serves  to  clarify  the  role  of  the  MGEEM  in  the  organizational  productivity 
Improvement  process.  Figure  1  depicts  the  Productivity  Analysis  Model  developed  by  the  Air  Staff 
Productivity  Office  (AF/PRME).  This  model  points  out  that  the  manager  can  control  all  or  some  of 
three  categories  of  factors  in  his/her  efforts  to  manage  productivity.  These  are:  mission, 
people,  and  the  methods  by  which  the  mission  is  accomplished.  In  the  center  of  Figure  1  is  a 
dial  which  indicates  the  level  of  productivity  change.  In  the  same  way  that  an  aircraft 
commander  monitors  the  dials  and  gauges  on  the  aircraft  Instrument  panel  to  control  the  aircraft, 
an  organizational  coinnander  needs  a  set  of  dials  and  gauges  to  monitor  and  control  the 
organization.  However,  few  organizations  have  a  satisfactory  "instrument  panel"  that  provides 
the  commander  with  the  information  needed  to  manage  productivity.  The  MGEEM  provides  a  way  for 
the  organization  to  build  that  instrument  panel  In  a  participative  fashion.  By  involving  members 
of  the  organization  in  the  process,  it  ensures  that  they  will  understand  the  measures,  believe  in 
them,  and  work  to  help  make  them  better.  A  measurement  system  that  is  widely  accepted  can 
provide  the  basis  for  application  of  the  basics  of  management:  planning,  organizing,  goal 
setting,  feedback,  controlling,  and  reinforcement. 


There  are  many  arguments  to  support  the  use  of  the  MGEEM.  However,  the  decision  comes  down 
to  the  extent  to  which  you.  as  commander  or  manager,  desire  to  make  your  organization  more 
efficient  and  effective.  If  you  sincerely  desire  to  help  your  organization  Improve,  not  for 
personal  gain,  not  to  "cover  your  six  o'clock  position."  but  because  you  feel  It  1$  the  right 
thing  to  do,  you  are  very  likely  to  succeed  with  this  technique. 


1.2.4  HBEEM  Field  Test  Results 

The  MGEEM  has  been  field  tested  In  24  Air  Force  organizations.  The  field  test  revealed  that 
the  method  produces  a  manageable  number  of  Indicators  for  an  organization.  Is  acceptable  to 
participants,  and  Is  cost  effective;  I.e.,  most  Indicators  defined  can  be  generated  from  existing 
data  In  the  organization.  Furthermore,  the  field  test  demonstrated  the  applicability  of  the 
MGEEM  to  organizations  of  varying  types  (e.g.,  weather  detachments.  Jet  engine  maintenance 
branches,  and  base  administration  divisions). 


1.2.5  Reactions  of  Air  Force  Personnel  to  the  MGEEM 

Following  the  field  test  In  their  organizations,  commanders  were  asked  to  comment  on  the 
process.  Some  of  their  reactions  are  listed  below. 

"The  process  was  extremely  beneficial  to  the  people  —  whole  unit,  now 
participants.  I  expect  morale  to  Improve  even  If  no  changes  are  made.  This, 
plus  the  feedback,  are  key  benefits." 

"Overall,  an  excellent  session!" 

"The  approach  was  sound  and  refreshing.” 

"We  served  to  prove  that  the  book  may  be  right." 

Reactions  from  enlisted  participants  were  also  quite  favorable: 

"Am  enthusiastic  about  the  procedures  used  In  the  measurement  process  because 
they  opened  our  eyes  to  the  duties,  requirements,  and  needs  of  the  other 
sections  In  our  Division.  The  manager/supervisor/technician  exchanging  Ideas 
In  this  type  of  atmosphere  seems  to  be  very  healthy  for  all  of  us." 

"Helped  me  gain  Insight  Into  the  overall  branch  mission  and  some  of  the 
problems  Incurred.  Also,  by  participating  In  the  process.  I  gained  a  feeling 
of  having  iny  views  considered  by  higher  headquarters." 

As  these  reactions  suggest,  the  MGEEM  Is  much  more  than  a  process  to  generate  KRAs  and 
Indicators.  It  Is  that;  however,  the  process  also  focuses  the  attention  of  people  In  the 
organization  on  their  common  purpose.  The  results  are  beneficial,  but  so  Is  the  process. 

Will  the  MGEEM  help  your  organization?  This  Is  a  question  that  only  you  can  answer. 
Hopefully,  this  manual  will  help  you  make  that  decision. 


1.3  Overview  of  this  Manual 


Chapter  2  briefly  discusses  some  basic  concepts  underlying  the  application  of  the  MGEEM, 
Including  a  description  of  the  system's  view  of  organizations,  basic  perspectives  on  productivity 
measurement,  and  the  characteristics  of  an  Ideal  measurement  system.  Chapter  3  describes  the 
phases  of  the  MGEEM  process.  The  process  Is  described  In  terms  of  decisions  the 
commander/manager  has  to  make  In  order  to  Implement  the  MGEEM  In  his/her  organization.  Chapter 
3  also  Includes  a  statement  of  anticipated  benefits,  costs,  and  risks  and  concludes  with  some  of 
the  pitfalls  to  be  avoided  In  an  MGEEM  Implementation.  Chapter  4  presents  examples  of  Indicators 
that  have  been  generated  for  use  In  a  wide  range  of  organizations. 


2.0  BASIC  CONCEPTS  UNDERLYING  THE  MGEEM 

2.1  Productivity  In  Air  Force  Organizations 

2.1.1  Introduction 

Understanding  productivity  In  Air  Force  organizations  requires  that  one  envision  the 
organization  as  a  "system."  This  section  discusses  some  basic  system  concepts  that  are 
fundamental  to  the  understanding  of  productivity  and  to  the  use  of  the  MGEEM.  Managers  who  are 
already  familiar  with  the  system's  view  of  organizations  may  want  to  skip  to  Section  2.3. 


Basic  System  Concepts 


A  system  Is  a  set  of  Interrelated  components  that  have  a  comon  purpose  or  goal.  An  Air 
Force  organizational  system  might  be  a  wing  or  a  squadron  or  even  a  small  work  team  within  a 
squadron.  Systems  can  be  small  or  large;  however,  they  all  have  a  set  of  Interrelated  components 
(e.g.,  people,  material,  equipment,  organizational  entitles)  that  share  a  common  mission. 


Systems  can  be  defined  In  terms  of  their  Inputs,  outputs,  goals,  and  Interactions  with  their 
environment  across  system  boundaries.  Let's  examine  these  concepts  for  a  military  organization, 
for  example,  a  communicatlons-navigatlon  (Comm-Nav)  branch  In  an  avionics  squadron.  This  branch 
performs  maintenance  on  the  on-board  comnunlcatlons  and  navigation  equipment  carried  by  aircraft 
In  the  wing. 

2. 1.2.1  Inputs.  As  a  general  rule.  Inputs  to  an  organization  can  be  classified  according  to 
the  categories  shown  In  Table  1. 


Table  1.  Categories  of  Inputs 


Labor 

Number  of  hours  worked 

Materials 

Number  of  pieces,  number 
of  units,  dollar  value,  etc. 

Capital 

Number  of  dollars  Invested, 
depreciation  value  of 
assets,  etc. 

Energy 

Number  of  kilowatt  hours  used,  number 
of  gallons  of  fuel,  etc. 

For  the  Com-Nav  branch,  labor  inputs  consist  of  the  total  number  of  assigned  personnel 
multiplied  by  the  number  of  duty  hours  in  the  period  under  consideration  (e.g.,  week,  month).  In 
certain  cases  it  may  be  desirable  to  adjust  the  total  labor  Input  for  such  factors  as  personnel 
on  temporary  duty  (TOY),  on  detail  to  other  units,  on  leave,  etc.,  to  arrive  at  a  total  number  of 
"available"  hours.  While  such  definitions  must  be  explicitly  agreed  upon,  labor  input  is 
typically  defined  In  terms  of  the  number  of  hours  spent  by  designated  personnel  during  a  given 
time  period.  In  most  military  organizations,  the  most  significant  Input  Is  labor. 

A  second  Input  category  for  the  Comm-Nav  branch  Is  materials.  In  order  to  perform  the 
mission,  personnel  must  be  supplied  with  spare  parts,  expendable  items  (e.g.,  non-capi tali  zed 
tools  and  equipment,  office  supplies).  Typically,  the  cooinon  scale  for  materials  is  dollars. 
Depending  on  the  accounting  practices  of  the  unit.  Item  values  can  be  expressed  In  terms  of 
Initial  cost  or  In  terms  of  replacement  cost. 

A  third  category  of  Inputs  Is  capital.  At  the  branch  level,  there  tends  to  be  little 
knowledge  of  the  capital  Investment  program  opportunities  or  the  process  by  which  assets  are 
capitalized.  If  you  are  Involved  with  a  wing  or  higher  level  organization,  capital  may  have  more 
Importance.  However,  the  unit  of  measurement  for  capital  assets  (buildings,  major  items  of 
equipment,  etc.)  is  units  or  dollars  of  depreciation.  (Refer  to  AFR  25-3  for  a  description  of 
Air  Force  capital  Investment  programs.) 

A  fourth  category  of  Inputs  Is  usually  called  energy.  This  category  Includes  the  electricity 
used  to  operate  the  facllltYf  the  fuel  used  to  power  vehicles  or  aircraft,  and  gas  or  oil  used 
for  heating.  In  the  case  of  the  Comm-Nav  branch,  energy  will  not  be  a  very  significant  Input. 
Perhaps  the  branch  owns  vehicles  and  can  have  an  Impact  on  the  gallons  of  fuel  used.  It  can 
affect  the  amount  of  electricity  used  or  the  energy  required  for  heating  Its  facilities;  however, 
these  energy  matters  are  typically  handled  by  a  centralized  resource  management  agency.  When  a 
single  energy  type  Is  being  considered,  it  Is  preferable  to  quantify  energy  in  terms  of  physical 
units  (gallons,  kilowatt  hours,  etc.).  However,  when  there  is  an  aggregation  Issue,  energy  units 
are  usually  converted  to  dollars. 

2. 1.2. 2  Outputs.  A  second  major  system  concept  Is  that  of  outputs.  An  output  is  a  product 
or  service  which  the  system  produces  In  order  to  achieve  its  purpose.  In  the  Conn-Nav  example, 
outputs  would  be  pieces  of  equipment  repaired,  personnel  trained,  reports  submitted  to  squadron 
headquarters,  etc.  Whatever  the  organization  produces  for  use  outside  its  own  organizational 
boundaries  Is  an  output.  A  distinction  Is  frequently  made  between  "Intermediate"  outputs  and 
"final"  outputs.  Intermediate  outputs  are  those  which  are  consumed  by  the  organization  Itself  or 
are  necessary  to  produce  final  outputs.  Final  outputs  are  those  that  the  organization  exports 
across  its  boundaries  to  other  organizational  systems. 

2. 1.2. 3  System  Boundary.  The  boundary  of  a  system  differentiates  it  from  its  environment. 
While  the  concept  of  boundary  is  "theoretical,"  It  has  Important  practical  implications.  In 
defining  the  Comm-Nav  branch  as  a  system,  where  does  one  draw  the  line?  For  Instance,  is  an 
individual  who  has  been  on  detail  to  the  squadron  for  3  months  within  the  system?  Are  the 
vehicles  on  permanent  loan  to  the  branch  from  the  motor  pool  part  of  the  Coimn-Nav  system  or  the 
motor  pool  system?  ()uestions  such  as  these  must  be  addressed  and  answered  in  order  to  define 
unambiguously  the  system  under  investigation.  Once  these  questions  have  been  answered,  the 
system  boundaries  become  clearer.  However,  It  should  be  noted  from  these  examples  that  boundary 
issues  deal  both  with  space  (e.g.,  area  occupied  by  system  components)  and  time  (e.g.,  the  length 
of  time  someone  will  be  away  from  the  organization  before  that  person  is  no  longer  considered 
within  the  system). 
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2. 1.2. 4.  Environment.  Once  the  system  is  defined  by  specifying  the  boundaries,  the 
environment  has  also  been  defined.  Anything  that  Is  not  part  of  the  system  Is  part  of  Its 
"environment."  Systems  survive  through  transactions  with  the  environment.  Personnel  resources, 
supplies  and  equipment,  and  energy  to  operate  the  system  all  flow  from  the  environment.  Relevant 
organizations  for  the  Com*Nav  branch  Include  the  maintenance  directorate,  the  avionics  squadron 
headquarters,  other  branches  In  the  avionics  squadron,  the  supply  organizations,  and  flight 
operations  (since  many  of  the  branch's  goals  flow  from  equipment  write-ups  made  by  flight 
crews).  Maintaining  effective  boundary  relationships  Is  a  critical  aspect  of  a  system's 
operation. 

2. 1.2. 5  System  Diagram.  These  basic  system  concepts  may  be  depicted  In  a  systems  diagram 
(Figure  2). 


ENVIRONMENT 


BOUNDARY 


ENVIRONMENT 


Figure  2.  Systems  Diagram. 


As  Figure  2  shows,  a  system  Is  defined  by  Its  boundary,  which  separates  It  from  Its 
environment.  In  an  open  system,  such  as  an  organizational  system.  Inputs  are  derived  from  the 
environment.  The  system  uses  those  Inputs  to  produce  outputs  which  are  exchanged  with  the 
environment.  As  this  very  simple  analysis  suggests,  an  organizational  system  must  manage  the 
process  of  converting  Inputs  to  outputs,  but  It  must  also  manage  Its  boundary  relationships  to 
assure  a  continuing  flow  of  Inputs.  In  most  organizational  systems,  the  flow  of  Inputs  Is 
dependent  on  the  extent  to  which  the  system  outputs  conform  to  the  requirements  of  the 
environment  (e.g.,  customers)  with  respect  to  quantity,  quality,  price/cost,  etc. 

2.2  Productivity  —  A  Systems  Concept 


Now  that  the  basic  components  of  an  organizational  system  have  been  Introduced,  productivity 
can  be  defined.  As  applied  to  Air  Force  organizations,  productivity  has  two  components: 
efficiency  and  effectiveness.  Efficiency  Is  concerned  with  the  quantity  of  inputs  required  to 
produce  a  given  level  of  outputs.  Effectiveness  refers  to  the  extent  to  which  the  outputs 
conform  to  mission  requirements.  These  definitions  are  expressed  In  AFR  25-3  as  follows: 


Productivity.  For  this  regulation,  productivity  Is  the  measure  of  an 
organization's  performance.  It  Is  not  only  "efficiency*  (the  ratio  of  Inputs  to 
outputs),  but  also  "effectiveness"  (to  what  extent  the  output  satisfies  mission 
objectives).  Put  another  way,  productivity  Is  concerned  with  both  doing  things 
right  (efficiency)  and  doing  the  right  things  (effectiveness),  (p.  2) 


2.3  Productfvity  Measureaent  —  A  Tool  for  Iiyrovement 


2.3.1  Measureaent  Is  Not  an  End  In  Itself 

Productivity  measurement  should  be  viewed  as  a  tool  for  Improvement.  From  the  commander's 
perspective,  the  main  reason  to  be  Interested  In  productivity  measurement  Is  to  make  productivity 
better.  Measurement  should  be  viewed  as  the  first  step  In  the  management  effort  to  enhance 
organizational  productivity. 


2.3.2  What  You  Measure  Is  What  You  Set 

Measurement  of  any  aspect  of  an  organization's  performance  sends  signals  throughout  the 
organization  as  to  what  the  conmander  views  as  Important.  Because  of  this  Impact  of  measurement. 
It  Is  Important  to  measure  the  right  things.  Since  resources,  time,  and  materials  tend  to  flow 
from  unmeasured  to  measured  aspects  of  organization  performance,  we  need  to  ensure  that  a 
productivity  measurement  system  covers  the  key  facets  of  an  organization's  mission. 


2.3.3  Measurement  Systems  Fall  If  They  tack  Acceptance 


In  order  for  a  measurement  system  to  be  a  productivity  enhancement  tool.  It  must  be 
understood  and  accepted  by  users  of  the  system.  If  not,  users  will  find  ways  to  avoid,  fake,  or 
otherwise  "defeat"  the  system.  Many  elegant  measurement  systems  Imposed  by  headquarters  or  staff 
experts  have  failed  because  they  did  not  gain  acceptance  by  those  being  measured.  One  way  to 
Increase  understanding  and  acceptance  by  the  users  of  a  measurement  system  Is  to  involve  them  In 
Its  development. 


2.3.4  Measurement  Is  a  Substitute  for  Direct  Observation 

When  measurement  for  Improvement  Is  the  goal,  measurement  can  serve  as  a  substitute  for 
direct  observation.  An  axiom  that  has  guided  military  commanders  through  the  years  is  to  ensure 
that  the  critical  aspects  of  performance  are  being  carried  out  through  Inspection.  In  most 
organizations  of  any  size.  It  Is  Impossible  for  the  commander  to  physically  Inspect  all  aspects 
of  performance  on  an  ongoing  basis.  Therefore,  measurement  becomes  a  substitute  for  direct 
observation.  In  addition.  In  Air  Force  organizations  where  products  or  services  are  Intangible, 
measurement  becomes  a  way  that  the  efforts  of  organization  members  are  made  concrete  and 
visible.  In  this  way,  measurement  serves  as  feedback  to  allow  members  to  know  how  well  they  are 
doing.  This  Is  a  critical  component  of  motivation  for  organization  members. 


2.3.5  Users  of  Measurement  Data  Must  Understand  Its  Limitations 

At  best,  productivity  measurement  Is  Imperfect.  It  Is  subject  to  fluctuations  sometimes 
beyond  the  control  of  the  measured  organization.  Despite  considerable  effort.  It  Is  not  always 
feasible  to  measure  all  aspects  of  performance  In  a  formal  way.  Thus,  productivity  measurement 
data  must  be  Interpreted  with  Judgment.  For  example,  when  the  number  of  hours  required  to  repair 
a  Jet  engine  Increases  for  a  reporting  period  by  20%,  this  will  be  understood  by  a  unit  commander 
who  knows  that  five  new  enlisted  mechanics.  Just  out  of  school.  Joined  the  unit  during  this 
period.  However,  someone  up  the  chain  of  command  who  notices  this  drop  In  efficiency  might 
attribute  It  to  other  causes  and  take  actions  that  are  Inappropriate. 


2.3.6  Most  Organizations*  Productivity  Can  Be  WMSured 


Given  the  tine  and  resources,  almost  anything  can  be  measured.  However,  the  feasibility  of 
measurement  may  be  a  different  Issue.  Not  all  aspects  of  productivity  that  can  be  measured  are 
worth  the  cost.  Determination  of  measurement  feasibility  Is  ultimately  a  judgment  of  the 
commander.  However,  It  Is  often  difficult  to  determine  the  value  of  a  particular  measurement 
Indicator  until  It  has  been  tracked  for  a  period  of  time.  Therefore,  managers  are  cautioned  to 
reserve  Judgment  about  the  feasibility  of  Indicators  until  there  are  some  data  upon  which  to  make 
a  valid  Judgment. 


2.4  Characteristics  of  an  Ideal  Measurement  System 

2.4.1  Covers  Important  Facets  of  the  Mission 


The  Ideal  measurement  system  should  Include  Indicators  which  encompass  the  most  Important 
facets  of  the  organization's  mission.  Measuring  only  a  single  aspect  of  the  mission  can  distort 
resource  allocation  decisions  and  lead  the  organization  to  overly  emphasize  one  aspect  of  Its 
mission  (e.g.,  quantity  of  work  accomplished)  at  the  expense  of  other  facets  (e.g.,  customer 
satisfaction  or  readiness). 


2.4.2  Should  Be  Understandable 


The  measurement  Indicators  and  reports  produced  for  commanders  and  members  of  the 
organization  must  be  comprehensible.  In  order  for  the  Information  to  have  value  In  guiding 
performance,  users  must  un<iersUn<i  how  their  performance  Is  reflected  in  the  numbers  that  are 
tracked. 


2.4.3  Should  Be  Controllable 

The  Indicators  comprising  the  measurement  system  should  be  under  the  control  of  the 
organization  being  measured.  This  does  not  mean  that  the  measured  organization  can  make  the 
numbers  say  what  they  want  them  to  say.  It  means  that  If  the  organization  does  a  better  or  worse 
Job.  the  numbers  should  change  accordingly.  There  should  be  a  clear  relationship  between  the 
performance  of  the  organization  and  changes  In  the  indicators.  In  other  words,  the  Indicators 
should  be  controllable  by  organization  members  through  their  performance. 


2.4.4  Includes  Indicators  of  Efficiency  as  Hell  as  Effectiveness 

A  balanced  set  of  indicators  should  Include  measures  of  the  Impact  or  outcome  produced  by  the 
outputs  of  an  organization  and  should  reflect  the  resources  consumed  In  producing  the  outputs. 
Experience  with  the  MGEEM  suggests  a  tendency  for  Air  Force  units  to  focus  on  effectiveness  more 
than  efficiency.  This  tendency  should  be  counteracted  by  emphasizing  the  need  to  track  resources 
consumed  In  relation  to  outputs  produced  (efficiency)  as  well  as  In  terms  of  how  well  the  mission 
Is  being  accomplished  (effectiveness). 


2.4.5  Values  Should  Provide  a  Retsonable  Dispersion 


It  does  little  good  to  track  productivity  Indicators  that  never  change.  For  example,  an 
organization  could  track  safety  by  monitoring  the  number  of  fatalities.  However,  fatalities  are 
very  rare  events,  fortunately,  and,  therefore,  make  poor  criteria.  A  more  useful  Indicator  would 
be  number  of  critical  Incidents  or  "near  misses,"  since  these  are  likely  to  occur  more  frequently. 


2.4.6  Indicators  Stwwld  Be  Useful 

Indicators  used  by  an  organization  should  reflect  activities  that  the  commander  and  members 
of  the  organization  wish  to  track  In  the  Interest  of  Improving  performance.  The  items  discussed 
above  are  examples  of  factors  which  affect  usefulness.  However,  since  costs  are  associated  with 
measurement,  an  organization  should  track  only  those  aspects  of  performance  for  which  the  value 
of  the  Information  outweighs  the  cost  of  measurement. 


2.5  Evolution  of  the  MGEEM 

The  MGEEM  Is  a  process  for  Identifying  productivity  Indicators  that  fulfill  the  criteria 
discussed  above.  The  process  was  developed  by  adapting  some  of  the  best  practices  of  Industry 
and  government.  The  MGEEM  has  been  tailored  for  use  In  Air  Force  environments  through 
discussions  with  coomuinders  and  field  testing  In  24  different  Air  Force  organizations.  The 
methodology  was  modified  based  on  these  experiences.  The  MGEEM  reflects  current  thinking  In  the 
field  of  productivity  management. 


3.0  THE  MGEEM  METHODOLOGY  •>  A  DESCRIPTION 

Implementation  of  the  MGEEM  should  be  viewed  as  a  series  of  steps  along  the  road  toward 
productivity  Improvement.  The  MGEEM  provides  no  miracle  cures  for  organizational  problems. 
However,  It  does  provide  fundamental  building  blocks  for  a  serious  effort  to  measure  and  Improve 
productivity  In  Air  Force  organizations.  If  there  Is  a  strong  management  commitment  to  Improve 
performance  In  collaboration  with  members  of  the  organization,  rather  than  at  their  expense,  this 
tool  can  be  helpful. 


3.1  The  Decision  to  Begin 

Once  you  have  decided  to  begin  the  MGEEM  process,  your  first  task  Is  to  clearly  frame  In  your 
mind  the  reasons  why  you  feel  productivity  enhancement  Is  essential  to  your  organization.  This 
step  Is  necessary  because  you  will  have  to  articulate  this  rationale  and  "vision"  to  members  of 
the  organization  many  times  as  the  MGEEM  process  unfolds.  People  are  not  enthusiastic  about 
having  their  performance  measured  for  Its  own  sake.  But,  feedback  on  how  people  are  doing  Is 
Interesting  to  them,  and  Its  use,  such  as  In  setting  up  competition  against  themselves  over  time 
or  against  similar  units  throughout  the  command,  can  stimulate  performance  gains.  People  need 
compelling  reasons  for  participating  In  the  measurement  of  their  performance.  As  a  manager  or 
coomander,  you  must  help  your  people  understand  why  performance  Improvement  can  help  the  Air 
Force,  why  It  can  help  your  organization,  and  perhaps  most  Importantly,  "what's  In  It  for  them." 
There  Is  considerable  evidence  that  the  most  Important  phase  of  any  productivity  Improvement 
effort  Is  creating  awareness  at  all  levels  In  the  organization  regarding  why  It  Is  Important.  As 
commander,  this  Is  your  responsibility. 
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As  you  work  through  this  phase  of  the  MGEEM  process,  you  should  discuss  your  Ideas  with  your 
vice  connander,  with  your  subordinates,  and  with  the  Individual  you  select  to  be  the  measurement 
facilitator  for  the  MGEEM  Implementation  In  your  unit.  Your  vision  must  become  a  shared  vision 
If  It  Is  to  guide  your  organization  to  Improved  performance. 


3.1.1  The  MMSurament  Facilitator 


To  assist  your  organization  In  the  Implementation  of  the  MGEEM,  the  services  of  a  measurement 
facilitator  are  required.  The  measurement  facilitator  Is  generally  someone  external  to  your 
organization  who  Is  skilled  In  group  process  activities  (e.g.,  running  meetings,  facilitating 
group  discussions.  Interviewing,  and  listening)  and  who  understands  the  basics  of  organizational 
performance  measurement.  Experience  suggests  that  the  combination  of  these  two  skills  Is 
critical  to  the  success  of  the  MGEEM.  In  Air  Force  organizations,  such  Individuals  might  be 
found  In  roles  such  as  management  engineering  technician,  quality  circles  facilitator,  human 
relations  trainer,  or  In  headquarters  consulting  organizations.  The  facilitator  should  become 
familiar  with  AFR  25-3,  which  Is  the  governing  regulation  for  the  Air  Force  Productivity 
Enhancement  Program.  The  glossary  In  this  regulation  will  be  especially  helpful. 


3.1.2  iai  ementatlon  Manual 

An  MGEEM  Implementation  manual  (Tuttle  i  Weaver,  ld86)  has  been  developed  by  the  Air  Force 
Human  Resources  Laboratory  (AFHRL)  to  guide  the  measurement  facilitator  In  the  process.  This 
manual  provides  detailed  step-by-step  assistance  and  should  be  obtained  from  AFHRL/MO,  Brooks 
AFB,  TX  78235-5601  (AV240-3551 ) . 


3.2  Selecting  the  Target  Organization 

Where  do  you  begin?  This  Is  a  question  which  will  Inmedlately  face  each  conmander  as  he/she 
starts  to  Implement  the  MGEEM.  The  short  answer  Is  to  begin  at  the  highest  feasible 
organizational  level  over  which  you  have  control.  If  you  are  a  squadron  commander,  then  yqu 
should  begin  at  the  squadron  level,  defining  the  squadron  as  the  "target  organization."  If  you 
are  a  wing  commander,  then  begin  at  the  wing  level.  If  you  are  a  branch  or  detachment  conmander, 
then  begin  at  that  level.  The  MGEEM  works  best  as  a  top-down  rather  than  as  a  bottom-up 
process.  This  Is  because  the  principal  Intended  accomplishments,  one  of  the  products  of  the 
MGEEM  called  KRAs,  established  at  one  organizational  level  serve  as  a  framework  for  developing 
KRAs  of  subordinate  level  organizations.  Top-down  Implementation  allows  organizations  to  ensure 
that  their  missions  and,  therefore,  KRAs  are  In  proper  alignment. 


3.3  Deciding  What  to  Measure 


Among  the  most  significant  contributions  of  the  MGEEM  Is  helping  the  members  of  the  target 
organization  decide  what  to  measure.  This  Is  much  more  than  a  technical  measurement  decision.  A 
management  engineer  could  stu4y  your  organization  and  suggest  measures  that  might  be  better  from 
a  technical  point  of  view.  However,  as  a  productivity  Improvement  tool,  this  misses  the  point. 
Productivity  Is  enhanced  not  because  an  organization  has  a  good  measurement  system,  but  because 
It  has  the  comnltment  of  Its  people  to  Improve  the  aspects  of  performance  that  are  measured.  The 
MGEEM  Is  a  methodology  for  helping  organizations  develop  productivity  KRAs  and  Indicators  that 
will  build  acceptance  and  commitment  to  the  measures  as  they  are  developed.  Participation  by 
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organization  nenbers  In  the  measureaient  development  process,  coupled  with  communication,  are  the 
key  Ingredients. 


3.3.1  Develop  Key  Result  Areas 


The  first  stage  of  the  NGEEM  process  Is  concerned  with  defining  measurable  facets  of  the 
organization's  mission,  labeled  KRAs.  KRAs  are  defined  through  the  use  of  a  structured  group 
process  technique  known  as  the  Nominal  Group  Technique  (NGT),  KRA  development  Involves  a  3-hour 
meeting  led  by  the  measurement  facilitator.  In  this  meeting,  the  ‘’management  team"  of  the  target 
organization,  augmented  by  the  commander  of  the  parent  organization  and  one  or  more  customer 
representatives.  Is  led  to  consensus  in  answering  the  question: 

"What  results  is  this  target  organization  expected  to  accomplish?" 


3.3.2  Develop  Productivity  Indicators 

For  each  KRA.  the  measurement  facilitator  then  leads  a  second  group,  the  "measurement 
development  team,"  through  a  series  of  steps  to  develop  efficiency  and  effectiveness  Indicators. 
Typically,  the  measurement  development  team  consists  of  working  level  representatives  of  the 
target  organization.  In  addition  to  the  management  team  who  participated  In  the  KRA  development 
process.  Indicator  development  also  makes  use  of  the  NGT  In  a  group  session  to  answer  this 
question  for  each  KRA: 

"What  efficiency  and  effectiveness  Indicators  should  the  commander  of  this 
organization  track  on  a  periodic  basis  to  tell  If  the  KRA  Is  being  accomplished?" 

Following  these  sessions  (normally,  two  or  three  3-hour  sessions),  there  Is  a  process  of 
polishing  and  refining  the  Indicators.  This  process  Involves  the  measurement  facilitator  and  key 
organizational  members.  Through  consideration  of  the  importance  and  feasibility  of  each 
Indicator,  the  set  of  Indicators  is  reduced.  For  example,  the  measurement  development  team  may 
suggest  20  to  25  indicators  for  consideration.  The  refinement  process  may  reduce  this  number  to 
6  to  10  which  are  Important  and  feasible  to  track  on  a  periodic  basis. 


3.4  Implementing  a  Tracking  System 


Once  the  Indicators  are  defined.  It  Is  necessary  to  develop  a  reporting  system  that  provides 
periodic  Information  to  management  and  organization  members.  There  are  many  possible  reporting 
systems,  and  the  organization  should  develop  a  simple  one  that  meets  its  own  specific  needs.  The 
NGEEM  Implementation  manual,  discussed  In  paragraph  3.1.2,  describes  such  a  reporting  system.  It 
enables  the  organization  to  set  goals  for  each  Indicator  and  to  aggregate  indicators  to  derive  a 
single  productivity  score  for  the  entire  organization.  In  addition,  the  suggested  system  permits 
management  to  differentially  weight  Indicators  according  to  their  Importance  In  arriving  at  an 
overall  productivity  score.  The  overall  performance  score  and  the  Individual  Indicator  scores 
can  be  used  to  develop  performance  Indices  to  assess  productivity  change  over  time.  Whether  this 
suggested  system  Is  used  or  not.  Its  features  are  valuable  In  aqy  tracking  and  reporting  system. 


3.5  Using  the  Results  to  laprove  Productivity 


Feedback  of  performance  results  Is  a  powerful  tool  which  can  be  used  to  Improve  performance. 
AFHRL  has  supported  an  extensive  research  and  development  (RSO)  effort  to  Identify  practical 
guidelines  for  the  use  of  feedback  by  Air  Force  organizations  to  Improve  and  sustain  performance 
and  productivity.  This  section  will  briefly  sumnarlze  the  most  significant  lessons  learned  from 
this  RiO.  For  more  detailed  treatment  of  this  subject,  refer  to  Pritchard,  Bigby,  Belting, 
Coverdale,  and  Morgan  (1981).  A  manual  focusing  on  the  use  of  feedback  Is  In  preparation. 


3.5.1  Mhat  Should  Be  Fed  Back? 

The  measurement  Information  contained  In  the  feedback  report  should  cover  all  Important 
aspects  of  the  target  organization's  work.  It  should  contain  both  overall  scores  and  scores  on 
sub-indices.  The  feedback  report  should  provide  quantitative  information  on  performance  for  the 
period  and  It  should  specify  "how  good"  that  level  of  performance  is  in  a  qualitative  sense. 
Finally,  as  previously  discussed.  Indicator  data  should  contain  Information  on  performance  that 
Is  controllable  from  the  target  organization's  point  of  view. 


3.5.2  What  SIwMild  Be  tl»e  Source  of  Feedback? 

The  feedback  report  should  derive  from  the  organizational  productivity  measurement  system 
developed  by  the  MGEEM  process.  It  should  be  produced  In  a  hard-copy  form  (e.g.,  computer 
report)  and  be  perceived  as  emanating  from  the  supervisor  or  unit  comnander. 


3.5.3  Miat  Form  Should  the  Feedback  Take? 

Feedback  reports  should  be  made  public  for  the  group  whose  productivity  Is  being  measured. 
This  may  be  achieved  by  giving  reports  to  all  organization  members  or  by  posting  the  data  In  a 
conspicuous  place  where  all  members  may  view  the  results.  The  frequency  of  feedback  depends  on 
the  nature  of  the  work  processes  on  which  the  measurement  data  are  based.  The  rule-of-thumb  Is 
to  provide  feedback  as  frequently  as  the  cycle  time  of  the  work  permits.  The  feedback  report 
should  Indicate  how  current  performance  compares  with  previous  performance  so  that  organizational 
members  can  see  the  changes  that  have  occurred  as  a  result  of  their  efforts. 


3.5.4  Linking  Measurement  to  Group  Problem  Solving 

Many  Air  Force  organizations  make  use  of  formal  or  Informal  mechanisms  to  Involve 
organizational  members  In  problem-solving  activities.  These  activities  have  labels  such  as 
advisory  councils,  quality  circles,  task  teams,  and  labor-management  committees.  Regardless  of 
the  type  of  employee  Involvement  process,  however.  It  Is  helpful  to  have  a  mechanism  that 
provides  quantitative  evidence  of  performance.  The  MGEEM  fulfills  this  need. 

The  MGEEM  measurement  process  deals  directly  with  three  Issues  that  are  usually  serious 
weaknesses  of  most  employee  Involvement  efforts.  First,  how  can  persons  Involved  In  such  efforts 
be  sure  that  they  select  for  study  relevant  problems  that  will  help  the  organization?  Second, 
how  can  management  support  for  such  work  be  maintained?  And.  third,  how  can  persons  In  such 
groups  demonstrate  that  their  efforts  pay  off  for  the  organization?  All  of  these  problems  are 
effectively  addressed  by  the  MGEEM. 


3.6  Evidence  of  the  Effects  on  Productivity  of  the  MGEEM  with  Feedback 


AFHRL  Is  sponsoring  a  multi-year  test  of  the  effects  on  organizational  productivity  of  the 
MGEEH  with  feedback,  goal  setting,  and  Incentive  systems  In  an  operational  Air  Force  setting. 
The  R6D  Is  being  conducted  In  four  organizations  (the  Receiving,  Storage  and  Issue,  Pickup  and 
Delivery,  and  Inspection  sections)  of  the  Materiel  Storage  and  Distribution  Branch  of  the  Supply 
Squadron  and  the  Conn-Nav  section  of  the  Maintenance  Squadron,  at  the  67th  Tactical 
Reconnaissance  Wing  at  Bergstrom  AFB,  TX.  The  MGEEM  was  used  to  create  XRAs  and  Indicators  for 
organizational  productivity  measurement  systems.  At  the  date  of  this  writing,  the  R&D  had 
progressed  through  the  measurement  of  productivity  In  the  baseline  period  and  after  the  feedback 
enhancement.  Results  show  Improvement  In  organizational  productivity  of  from  3St  to  50%. 
Technical  papers  which  document  this  research  are  forthcoming  from  AFHRL. 


3.7  Costs  and  Risks  Associated  with  the  MGEEM 

The  major  cost  of  the  MGEEM  process  Is  the  time  of  the  commander  and  other  participants.  As 
with  any  management  Initiative,  the  commander  and  management  team  must  attend  the  MGEEM  sessions 
and  show  visible  support  for  the  process.  This  must  not  be  delegated  to  subordinates.  During 
the  course  of  Indicator  development,  the  process  could  require  up  to  30  hours  of  the  commander's 
time  spread  over  a  period  of  4  to  12  weeks.  The  time  requirements  of  other  organizational 
members  will  be  less  than  that  of  the  commander.  Involving  approximately  6  to  12  hours  during  the 
same  time  period. 

Risks  associated  with  the  process  Include  the  possibility  that  measurement  data  will  be 
misused.  In  the  hands  of  an  authoritarian  manager,  ar\y  measurement  data  could  be  used  to 

"tighten  the  screws"  on  organization  members.  Although  such  a  strategy  may  lead  to  short-term 
performance  Improvements,  gains  are  likely  to  deteriorate  over  time  as  morale  suffers. 

A  second  risk  Is  that  data  collected  at  the  local  organization  level  may  be  obtained  by 

higher  headquarters  personnel  who  do  not  understand  the  associated  limitations.  If  so.  actions 
may  be  taken  for  the  measured  organization  which  are  unwarranted. 

Finally,  measurement  may  serve  to  focus  management  attention  on  Issues  that  previously 
received  little  attention.  Attention  may  shift  because  the  organization  had  been  previously 
measuring  the  “wrong  thing";  I.e.,  aspects  of  performance  that  were  easy  to  measure  but 

relatively  unimportant.  Or,  the  measurement  process  may  point  out  to  management  aspects  of 
performance  that  serve  as  a  barrier  to  personnel  In  getting  the  Job  done  (e.g.,  downtime  of 

support  equipment).  This  shift  In  focus  may  lead  to  a  reallocation  of  resources  which  may  be 
threatening  to  some  personnel  In  the  organization.  However,  If  the  organization  measures  the 
right  things,  such  a  reallocation  should  be  of  benefit  to  the  organization. 


3.8  Pitfalls  to  Be  Avoided 

As  is  the  case  with  any  management  or  performance  Improvement  strategy,  there  are  a  number  of 
possible  problems.  Most  of  these,  however,  can  be  avoided  through  judicious  use  of  the 
technique.  This  section  will  draw  on  the  authors'  field  experience  with  the  MGEEM  and  from  the 
research  of  Locke  and  Latham  on  goal  setting  (Locke  S  Latham,  1984). 


3.8.1  Fear  of  Being  Measured 


Individuals  often  express  fear  or  anxiety  about  the  measurement  of  their  performance,  but 
these  fears  can  be  ameliorated.  One  such  concern  Is  the  fear  of  failure.  This  can  be  dealt  with 
by  encouraging  the  group  to  set  goals  with  productivity  measurement  data  that  are  challenging  but 
attainable.  A  second  fear  Is  repercussions  from  higher  headquarters.  This  Is  often  grounded  In 
a  past  history  of  having  been  "called  on  the  carpet"  for  a  performance  problem.  Inspection 
report,  customer  complaint,  etc.  The  facilitator  can  reduce  this  fear  by  conducting  the  MGEEM 
procedure  such  that  the  next  higher  level  commander  Is  Included  In  the  KRA  development  process. 
This  will  help  break  down  barriers  and  Increase  understanding  up  the  line.  Secondly,  reports 
submitted  up  the  line  should  be  summary  reports  that  do  not  provide  detailed  Information  on  each 
Indicator  tracked.  This  reduces  the  potential  for  "micro-management"  from  above.  For  example, 
an  agreement  might  be  struck  with  the  next  higher  level  commander  that  reports  submitted  Include 
only  an  aggregate  performance  Index  and  show  only  change  from  a  baseline  period.  This  would 
provide  a  degree  of  Insulation  for  the  lower  level  commander,  but  still  provide  considerable 
accountability  for  results. 


3.8.2  Goals  as  Ceilings 


Goals  are  Intended  to  serve  as  targets  which  encourage  performance  Improvement.  However, 
goals  can  operate  as  ceilings  which  discourage  further  effort  once  the  target  Is  reached.  The 
key  to  avoiding  celling  effects  Is  to  establish  In  the  organization  an  "ethic"  of  continual 
performance  Improvement.  That  Is,  regardless  of  the  level  of  performance  attained,  there  Is  an 
accepted  need  to  make  further  Improvements.  However,  unless  this  rationale  Is  supported  by 
"rewards"  and  "reinforcers"  for  excellent  performance,  this  ethic  will  not  be  sustained.  In  most 
Air  Force  organizations,  there  Is  an  ethic  of  high  performance,  but  to  sustain  this  ethic, 
commanders  must  seek  new  ways  to  recognize  and  reward  members  for  high  performance.  The  MGEEM 
process  provides  a  means  by  which  an  organization  can  compete  with  Itself  over  time.  This  Is 
healthy  If  reinforced  by  the  commander  and  can  overcome  celling  effects  associated  with  goals. 
Through  competition,  goals  will  be  raised. 


3.8.3  Won-Goal  Areas  May  Be  Ignored 

In  productivity  measurement.  It  Is  axiomatic  that  "what  you  measure  Is  what  you  get.  "There¬ 
fore,  cooBianders  and  managers  need  to  ensure  that  only  Important  facets  of  organizational 
performance  are  measured.  The  MGEEM  promotes  this  by  forcing  the  Indicator  development  process 
to  take  place  in  relation  to  KRAs.  Therefore,  use  of  the  MGEEM  makes  It  difficult  to  simply 
develop  a  set  of  Indicators  that  are  easy  to  measure  and  avoid  Important  performance  areas.  At 
least,  with  the  MGEEM,  non-measured  Important  areas  will  be  Identified. 


3.8.4  Gaming  the  System 

As  with  any  measurement  system,  there  Is  a  potential  for  "gaming."  Individuals  are  very 
creative  with  respect  to  means  of  "giving  the  boss  what  he/she  wants  to  see."  Controls  for  this 
tendency  must  attack  the  motivation  to  "fake"  rather  than  attempt  to  make  the  system  fake  proof. 
Much  of  what  has  been  said  above  deals  with  this  Issue.  Reducing  the  fear  of  higher  headquarters 
Intervention,  Involving  the  organization  In  the  development  of  the  measurement  system,  and 
creating  an  ethic  of  continual  performance  Improvement  are  all  efforts  to  reduce  the  motivation 
to  "game  the  system."  If  members  of  the  organization  feel  that  they  "own"  the  system,  there  Is 
less  motivation  to  game  it. 


4.0  EFFICIENCY  AND  EFFECTIVENESS  INDICATORS  •  SELECTED  EXAMPLES 


The  NGEEM  has  been  applied  In  a  wide  range  of  both  military  and  civilian  organizations.  This 
section  presents  some  of  the  Indicators  that  have  resulted  from  these  applications.  This  section 
Is  presented  to  Illustrate  Indicators  that  have  been  actually  developed  In  operational  settings. 
There  Is,  however,  no  Intention  that  an  organization  should  adopt  the  Indicators  Identified.  It 
Is  a  core  premise  of  the  NGEEM  methodology  that  each  organization  should  go  through  the  process 
of  developing  Its  own  Indicators.  It  Is  ownership  that  Is  Important.  Ownership  comes  from 
having  members  of  the  organization  participate  In  the  iiieasurement  development  process.  The 
following  Indicators,  expressed  In  ratio  form,  were  actually  developed  participatively  In 
operational  settings: 


Standard  number  of  days  to  process  requisitions 


Number  of  customer  Inquiries  satisfied 


Number  of  dollars  of  revenue  from  transient  housing* 
Operating  expenses  for  transient  housing 
Number  of  days  family  housing  units  are  occupied* 
Number  of  days  available 


4.4  Installation  Mdlntenance  and  Repair 
Number  of  delinquent  service  orders 
Total  number  of  service  orders  received 
Number  of  square  feet  maintained* 

Labor,  capital,  material,  and  energy  costs  of  maintenance 

4.5  Civilian  Personnel 
Total  number  of  days  to  fill  vacant  positions 
Number  of  vacant  positions  filled 
Number  of  classification  appeals  sustained 
Number  of  appeals  filed 


4.6  Contracting 

Number  of  days  to  issue  procurement  solicitations 
Total  number  of  solicitations  issued 
Number  of  purchase  requisitions  processed 
Number  of  elapsed  days 

Number  of  contract  dollars  to  minority  firms 
Total  value  of  contracts  awarded 


4.7  Base  Administration 
Number  of  times  supplies  not  available 


Number  of  requests  for  supplies 


es 


Nuinber  of  pieces  of  equipment  In  use 

Actual  number  of  hours  worked  on  administrative  Job  responsibilities* 


Expected  number  of  hours  worked 
Number  of  backlogged  work  orders 


Number  of  work  orders 


4.8  Base  Heather  Detachment 


Number  of  weather  warnings/advisories  with  sufficient  lead  time 


Number  of  warnings/advisories  Issued 
Number  of  weather  warnings  that  verify 


Number  of  warnings  Issued 

Number  of  late  Officer  Effectiveness  Reports  (OERs)  and  Airman  Performance  Reports  (APRs) 


Total  number  of  OERs  and  APRs 


4.9  Jet  Engine  Maintenance 


Number  of  engine  test  cell  rejects 

4.9.1  - 

Number  of  engines  tested 

Number  of  direct  (production)  hours 

4.9.2  - 

Number  of  Indirect  labor  hours 

Average  number  of  days  to  return  engine  to  serviceability* 

4.9.3  - 

Expected  number  of  days  to  return  engine  to  serviceability 

Average  time  required  to  upgrade  from  3  to  5  level 

4.9.4  - 

Comnand-wlde  average  time  to  upgrade  from  3  to  5  level 

*Ind1cates  those  Indicators  that  are  classified  as  efficiency  Indicators.  Efficiency  as  defined 
here  refers  to  three  types  of  Indicators: 

1.  Those  which  relate  actual  Inputs  to  expected  or  standard  Inputs  (e.g..  Item  4.9.3); 

2.  Those  which  relate  outputs  to  Inputs  (e.g.,  4.4.2);  and 

3.  Those  which  relate  resource  utilization  to  resource  availability  (e.g.,  4.3.3). 

Indicators  not  marked  with  *  are  effectiveness  Indicators.  Such  Indicators  measure  goal 
attainment,  quality,  and  Impact  on  customers  or  other  organizations. 
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